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LOW-DENSITY PARITY-CHECK CODES FOR MULTIPLE CODE RATES 
FIELD OF THE INVENTION: 

* 

The present invention relates to parity-check codes for encoding and decoding 
transmissions that may be at one of several transmission rates. The invention is 

\ 

particularly valuable when used with low-density parity-check (LDPC) codes, though it 
may be used with any block coding scheme. The present invention has application to 
- wired and wireless communication systems. 

BACKGROUND OF THE INVENTION: 

Low-density parity-check (LDPC) codes have recently been the subject of increased 
research interest for their enhanced performance on additive white Gaussian noise 
(AWGN) channels. As described by Shannon's Channel Coding Theorem, the best 
performance is achieved when using a code consisting off very long codewords. In 
practice, codeword size is limited in the interest of reducing complexity, buffering, and 
delays. LDPC codes are block codes, as opposed to trellis codes that are built on 
convolutional codes. LDPC codes constitute a large family of codes including turbo 
codes. Block codewords are generated by multiplying (modulo 2) binary information 
words with a binary matrix generator. LDPC codes uses a check parity matrix H, which 
is used for decoding. The term low density derives from the characteristic that the check 
parity matrix has a very low density of non-zero values, making it a relatively low 
complexity decoder while retaining good error protection properties. 

The parity check matrix H measures (N-K) x N, wherein N is number of elements in a 
codeword and K is the number of information elements in the codeword. The matrix H is 
also termed the LDPC mother code. For the specific example of a binary alphabet, N is 
the number of bits in the codeword and K is the number of information bits contained in 
the codeword for transmission over a wireless or a wired communication network or 
system. The number of information elements is therefore less than the number of 
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codeword elements, so K < N. Figures 1 A and IB graphically describe an LDPC code. 
The parity check matrix 20 of Figure 1 A is an example of a commonly used 5 1 2 x 4608 
matrix, wherein each matrix column 22 corresponds to a codeword element (variable 
node of Figure 1 B) and each matrix row 24 corresponds to a parity check equation (check 
5 node of Figure 1 B). If each column 22 of the matrix H includes exactly the same number 
m of non-zero elements, and each row 24 of the matrix H includes exactly the same 
number k of non-zero elements, the matrix 20 represents what is termed a regular LDPC 
code. If the code allows for non-uniform counts of non-zero elements among the 
columns 22 and/or rows 24, it is termed an irregular LDPC code. 

10 

Irregular LDPC codes have been shown to significantly outperform regular LDPC codes, 
which has generated renewed interest in this coding system since its inception decades 
ago. The bipartite graph of Figure IB illustrates that each codeword element (variable 
nodes 26) is connected only to parity check equations (check nodes 28) and not directly to 

1 5 other codeword elements (and vice versa). Each connection, termed a variable edge 30 or 
a check edge 3 1 (each edge represented by a line in Figure 1 B), connects a variable node 
26 to a check node 28 and represents a non-zero element in the parity check matrix H. 
The number of variable edges 30 connected to a particular variable node 26 is termed its 
degree, and the number of variable degrees 32 are shown corresponding to the number of 

20 variable edges 30 emanating from each variable node 26. Similarly, the number of check 
edges 3 1 connected to a particular check node 28 is termed its degree, and the number of 
check degrees 34 are shown corresponding to the number of check edges 3 1 emanating 
from each check node 3 1 . Since the degree 32, 34 represents non-zero elements of the 
matrix H, the bipartite graph of Figure IB represents an irregular LDPC code matrix. 

25 The following discussion is directed toward irregular LDPC codes since they are more 
complex and potentially more useful, but may also be applied to regular LDPC codes 
with normal skill in the art. 

Irregular codes can be designed for many different symmetric channels via density 
30 evolution and genetic hill-climbing algorithms (i.e., Differential Evolution) by adjusting 
variable edge polynomial X(x) and check edge polynomial p(x), defined as: 



2 



di d r 

X(x) = ]jjT X { x iA and p{x) = ]T A* H 

where {/i 2 , A3 } and {p 2 ,p 3 >—A/ r } are the edge distributions indicating the fraction 

of edges 30, 31 connected to variable and check nodes of degrees {2, 3, . . Mi} and {2, 3, 
5 „ .d r } , respectively, out of the total number of edges; The edge distributions determine 
the asymptotic performance of the code ensemble, the code rate of the ensemble, and any 
code realizations derived from the distributions. The coding rate R for an LDPC code is 
R=K/(N-P), wherein P is the number of punctured elements, detailed below. Preferably, 
a transmission can be sent using a plurality of adaptive coding rates. 

10 

Figure 2A is a prior art logical block diagram showing operation of a discrete 
communication system 36A using an LDPC coding scheme of multiple coding rates for 
its error control. An information source 38 outputs a K dimensional sequence of 
information bits s into a transmitter 3 9 A, the transmitter including at least an encoder 

15 40A, a modulation block 42, and storage 35 A, 37A. An LDPC encoder 40 encodes the 
sequence s into an N dimensional codeword t by accessing a stored LDPC mothercode 
37A and one of several stored puncture sequences 3 5 A, one puncture sequence 
corresponding to one code rate. The codeword t is broken up into sub-vectors, which are 
then modulated and up-converted at a modulation block 42 and transmitted as a vector x 

20 of the sub-vectors over one or more channels 44. Additive white Gaussian noise n is 
added at the channel and/or from system hardware, so that the vector y=x+n is input into 
a receiver 45A. The receiver 45A includes at least a demodulation block 46, a decoder 
48 A, and memory storage for the same LDPC mother code 37A and the same puncture 
sequences 35A used by the transmitter 39A. Since x and n are uncorrected and the 

25 modulation is memoryless, the received vector y can be demodulated symbol-by-symbol 
at a demodulating block 46, producing a hard decision vector fon the received 
information vector t . Probabilities of the decision being correct are also calculated at the 
demodulation block 46, and all this is input into an LDPC decoder 48 A that iteratively 
decodes the entire received code block and outputs a decoded information vector § to an 

30 information sink 50. 
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The two prior art LDPC coding systems known to the inventor require significant non- 
volatile memory for each coding rate for a single mother code. In a first prior art 
approach, a different LDPC code is designated for each coding rate and channel (i.e., 
5 different code realizations from different A,(x) and p(x) corresponding to the desired code 
rates). This approach uses one LDPC code for each coding rate, and may increase 
substantially when the set of code rates is large and/or when code words are long. The 
storage requirements can render this approach prohibitive for adaptive coding and 
modulation schemes operating in slowly varying channels. 

10 

The second known prior art approach is to take a single LDPC code and puncture 
codeword elements using multiple puncturing sequences chosen at random using 
puncturing probabilities. This approach requires storage of multiple puncturing 
sequences, one for each code rate, which may become prohibitive for a large set of coding 
1 5 rates and/or long codeword lengths. Figure 3 illustrates the storage requirements of such 
a system. To support all possible code rates of a punctured LDPC mother code, the 
system would need to store N-K different puncture sequences 52. Each horizontal line 
represents a unique stored puncture sequence 52, indexed as Si, S2, S3, ... Snjo that 
applies to a specific coding rate Ri, R 2 , R3, . . -Rn-k. The total memory requirement for 

20 such a system is 2^ Hl i uncompressed memory elements. 

Besides substantial amounts of memory required to store prior art puncturing sequences 
for various coding rates, the determination of the puncturing sequences is itself 
computationally intensive. Like the coding systems themselves, the prior art reveals at 
25 least two distinct methods for designing a puncture sequence. The first method is based 
on linear programming to determine puncturing probabilities that maximize the 
puncturing fraction: 

for a given signal to noise ratio (SNR, or bit/symbol energy to noise power spectral 
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density Eb/No) threshold, wherein X } represents the fraction of variable nodes 26 of 

r degree j. The other prior art approach to puncture sequence design is based on 
differential evaluation based on Density Evolution, which is somewhat more complex 
than the linear programming method described immediately above with near identical 
5 results. Each of these approaches for designing the puncture sequences are very 
computationally expensive, and their resulting sequences themselves require so much 
storage as to be potentially prohibitive for an adaptive coding system. 

Thus, each of the known prior art approaches require substantial amounts of storage to 
10 implement a wide variety of code rates. It is anticipated that neither of the prior art 
approaches are suitable for future communication systems that employ adaptive coding 
and implement a wide range of coding rates. Additionally, each of the two noted prior art 
approaches in designing puncture sequences are computationally intensive. What is 
needed in the art is a more elegant set of puncture codes that will not require so much 
15 storage as to make their use prohibitive in the adaptive coding rate communications 
systems that represent what may be a large portion of future communications. Ideally, 
such an elegant set of puncture codes would also submit to a more straightforward 
method of determining them, so that more sets of such codes could be developed and 
optimized for different applications to close further on the theoretical Shannon capacity 
20 limit. 

SUMMARY OF THE INVENTION: 

The present invention is directed to a coding/decoding system that is more compatible 
25 with adaptive coding communication systems, especially by requiring less memory. The 
present invention may be embodied in a communication unit such as a transmitter, in a 
receiver, or in a transceiver that may puncture codewords at any of several code rates, 
puncture meaning to remove or to add an element to the codeword in accordance with 
known practice. In accordance with one aspect of the present invention, the 
3 0 communication unit for a multiple code rate communication system includes a codeword. 
The codeword defines N codeword elements, K information elements, and P punctured 
elements. The particular code rate is R-K/(N-P). The transmitter or receiver further 
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includes a first storage location for storing an error reduction code mother code. 
Preferably, this is an LDPC mother code such as a parity check matrix of dimensions of 
(N-K) rows and N columns. 

5 The communication unit further includes a second storage location for storing a 
maximum puncture sequence S max . S max is the puncture sequence for a maximum code 
rate R max , and preferably S max =S N -K- S max itself includes at least one subset Si that is a 
puncture sequence for a minimum code rate R\. Si, and preferably all other puncture 
sequences corresponding to code rates less than R max , are each a subset of S max . This 
10 reduces the memory requirements as compared to prior art puncture sequencing. 
Preferably, S1QS2Q. ..<~S max _i<=S max . Preferably, S max is a plurality of memory elements, 
each of which is a variable degree . Alternatively, the memory elements may be variable 
node locations, check node locations, or check degrees. 

15 Another aspect of the present invention is a computer program embodied on a computer 
readable medium for determining a puncture sequence for a codeword. The computer 
program includes a first storage location for storing a LDPC mother code. It also 
includes a second storage location for storing a plurality of memory elements Mail that in 
combination comprise a maximum rate puncture sequence S max that corresponds to a 

20 maximum code rate R max . The computer program further includes a first set of computer 
instructions for reading a first subset of memory elements M set i . The number of the first 
subset of memory elements is less than the number of the plurality of memory elements 
that comprise the maximum rate puncture sequence. The specific memory elements M set i 
comprises a puncturing sequence Si that corresponds to a code rate Ri that is less than 

25 Rmax' 

Another aspect of the present invention is a method for determining a puncture sequence 
S for an ensemble of low-density parity-check (LDPC) codes. The method includes 
selecting at least one design criteria for an ensemble of LDPC codes and a stop criteria. 
30 A mean input LLR values, m Uo , is then calculated that achieves the design criteria on the 

ensemble of codes. A variable degree j is selected, within the design criteria, for 
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puncturing that requires one of a smallest mean input LLR value or a smallest decoding 
complexity. The variable degree is then appended to the puncturing sequence, and the 

puncturing probability is adjusted for the punctured variable degree, 7T ( P . The above 

actions, beginning with calculating the mean input LLR value, until the stop criteria is 
5 reached. Various design criteria and stop criteria are described, as well as considerations 
in determining the puncturing probability. 

BRIEF DESCRIPTION OF THE DRAWINGS: 

1 0 Figure 1 A is a matrix of an illustrative Low-Density Parity-Check mother code. 

Figure IB is a bipartite graph depicting connections between variable and check nodes. 

Figure 2A is a logical block diagram of a communication system of the prior art. 

Figure 2B is a logical block diagram of a communication system according to the present 
invention. 

15 Figure 3 is a block diagram depiction of puncture sequences for various rates according to 
the prior art. 

Figure 4 is similar to Figure 3, but according to a preferred embodiment of the present 
invention. 

Figure 5 is similar to Figure 4, but according to an alternative embodiment of the present 
20 invention. 

Figure 6 is a graph comparing memory requirements for the present invention versus the 
prior art for a LDPC mother code of rate 0.5. 

Figure 7 is a graph showing puncturing probabilities for a codeword of length N=1082 
mother code at various code rates. 

25 Figure 8 is a graph similar to Figure .7 wherein N=3255. 

Figure 9 is a graph showing Bit Error Rate performance for a mother code of length 
N=1082. 

Figure 10 is a graph similar to Figure 9 but showing Codeword Error rate performance. 
Figure 1 1 is a graph showing Et/No gap from the Shannon Limit for BER=lxl0~ 3 and 
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N-1082. 

Figure 12 is a graph showing required Eb/No ratio to achieve BER=lxl(T for N=1082. 
Figure 13 is a graph similar to Figure 9 for N=3255. 
Figure 14 is a graph similar to Figure 10 for ISN3255. 
5 Figure 15 is a graph similar to Figure 1 1 for 1NM3255. 
Figure 16 is a graph similar to Figure 12 for N-3255. 

DETAILED DESCRIPTION OF THE INVENTION: 

10 The present invention enables an LDPC encoder or decoder to use significantly less 
memory than prior art approaches by using a single puncture sequence Sn-k for the 
maximum rate R ma x> and forcing all puncture sequences S x for lesser rates R x to be a 
subset of the maximum rate puncture sequence Sn-k. Consider the communication 
system 36B of Figure 2B, which is similar in many respects to that of Figure 2A. The 

15 communication system 36B would like to communicate K bits of information per 
codeword using different code rates by puncturing the code words encoded from a single 
LDPC mother code of rate Kj N where N is the length of the code words (i.e. number of 

elements in the each code word). The encoder 40B selects and punctures P codeword 
bits by removing these bits from the codeword elements that are to be sent through the 
20 channel 44. Thus, the puncture count, P e {0,1, . . . , N - K} , determines the effective code 

rate of K/(N - P) . The encoder 40B accesses memory that stores a LDPC mother code 

37B and a maximum code rate puncture sequence S max 35B. S max corresponds to the 
maximum code rate R max . For lesser code rates, subsets of S max determine the puncture 
sequence, so all of the puncture sequence information is stored in S max 35B. 

25 

At the receive end of the communication, the demodulation block 46 receives the 
distorted codeword without the P punctured bits that were never sent. Before decoding 
the codeword, the decoder 48B reconstructs the entire codeword by inserting values that 
do not bias the decoding (i.e. neutral with respect of decoding a zero or a one) of 
30 punctured bits back into the P punctured locations (e.g. zero if log-likelihood-ratio 



8 



values are used as inputs into the sum-product decoder). The decoder 48B accesses 
memory that stores the same LDPC mother code 37B and the same maximum code rate 
puncture sequence S max 35B as the transmitter 39B. Then, the decoder 48B decodes the 
reconstructed codeword attempting to correct any errors due to the communication 
5 channel 44 along with the punctured bits. Both the transmitter and the receiver store the 
LDPC mother code 37B and a puncturing sequence 35B that can be used, in whole or in 
part, for any of the different code rates. 

Two embodiments are shown graphically at Figures 4 and 5, respectively. In the 

1 0 embodiment of Figure 4, the maximum puncture sequence Smax^SN-K is represented by a 
relatively long sequence of memory elements 54, which are depicted as sequential but 
need not be stored in physically adjacent areas of a volatile memory. A first puncture 
sequence S i is stored at a first memory element 54a, which is the first memory element of 
the sequence of memory elements that comprise the maximum rate puncture sequence Sn- 

15 k. In terms of the matrix H of Figure 1 A, the first puncture sequence may represent either 
the non-zero element locations (variable node locations) or the number of non-zero 
elements (variable degree) of the first column. A second puncture sequence S2 is stored 
at a first 54a and second 54b memory elements, which are the first two memory elements 
of the sequence of memory elements that comprise the maximum rate puncture sequence 

20 S n _k. In terms of the matrix H of Figure 1 A, the second puncture sequence may represent 
either the non-zero element locations (variable node locations) or the number of non-zero 
elements (variable degree) of the first and second columns. By this arrangement, Si is a 
subset of S2, which is a subset of S3, etc., and all are subsets of Sn-k. This relation is 
written as SicS2<-S 3 c...cSn-k. Both the transmitter and receiver store the same 

25 predetermined sequence for a given LDPC mother code in memory. For the code rate 
Kf (N-P), each terminal would then use the first P elements of the same S N _ K 

puncture sequence for the mother codeword. 

The puncture sequence S max may or may not be the entire matrix H [of dimensions (N- 
30 K)xN] because the maximum practical puncture sequence S N . K , may not be available. 
For example, assume a codeword length N=3000, K=1000 information elements, and 
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P=number of punctured elements. Without puncturing, the rate is K/N=l 000/3000-^0.33. 
With puncturing, the code rate varies by R=K/(N-P), and depends upon how many 
elements are punctured. For P-500, the rate is increased only to R= 1000/2500=0.4. For 
P^IOOO, the rate is R=0.5. For P=(N-K)=2000, the rate is K/K-l . Further puncturing 
5 beyond P= = 2000 is not desirable because P=(N-K) already results in the maximum 
possible coding rate. A transmitter or receiver may artificially bound the maximum 
coding rate to less than R=l to ensure that some repetitive transmission always occurs to 
ensure accuracy. 

10 As in Figure 4, the embodiment of Figure 5 shows the maximum puncture sequence S n _k 
is represented by a relatively long sequence of memory elements 54. The first puncture 
sequence Si is stored at a first memory element 54a as in Figure 4. The second puncture 
sequence S2 is stored at the second 54b and third 54c memory that comprise the 
maximum rate puncture sequence S N -k. The third puncture sequence S3 is stored at the 

15 third 54c, fourth 54d and fifth 54e memory elements that comprise the maximum rate 
puncture sequence Sn-k, and so forth. In the embodiment of Figure 5, each of the 
puncture sequences S x includes one and only one memory element that is not a memory 
element in the puncture sequence S x+ i corresponding to the next faster rate R x +i. The 
embodiment of Figure 5 may also include either an algorithm to determine reference 

20 points or an additional sequence [no longer than (N - K) ] that stores the reference points 

T 

(e.g. starting or ending locations such as 54c and 54e for S3) of all the subsets S x , one for 
each code rate (i.e. puncture count P ). Another embodiment arranges the subsets S x to 
straddle the serial sequence endpoints to form contiguous subsets of a circular sequence. 

25 For each code rate supported by the system 36B, both the encoder 40B in the transmitter 
and the decoder 48B in the receiver must know the puncture locations within the 
codeword beforehand. In this invention, the locations of these P punctures are preferably 

» 

contiguous subsets selected from a single puncture sequence S N _ K of length (N-K). 

Either variable degrees 32 or variable node locations 26 in the codeword compose the 
30 individual elements of the puncture sequence S N _ K . Indeed, the sequence's length may be 

shorter than (N - K) if the communication system 36 strictly bounds the maximum code 
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rate R max below one. 

For a given variable degree sequence, all node 26 permutations within each individual 
degree 32 are just different node realizations of that degree sequence. In implementation, 
5 a communication system 3 6 would preferably use a single sequence of variable nodes 26 
and not variable degrees 32. However, determining variable node 26 permutations within 
each variable degree 32 is just one embodiment of the degree sequence. 

Figure f 6 is a graph comparing memory elements required by the present invention as 
1 0 compared to those required by the prior art approach for puncturing set forth above, using 
a mother code of rate 0.5 and for various codeword lengths. For all possible code rates, 

the prior art requires 7 i memory elements to store the uncompressed puncturing 

* 

sequences S x . Embodiments of the present invention detailed above require only 
(N - K) memory elements 54. Using state of the art codeword lengths ranging from 

15 lxl 0 3 to lxl 0 6 , this memory difference between the two can be several magnitudes of 
order for long code words. 

The present invention is not limited to those examples above wherein the subsets S x are 
contiguous. For example, non-contiguous subsets S x may be chosen and an additional 
20 identifier of starting point and either subset length or subset ending point may be stored in 
addition to the mother code and the maximum rate puncture sequence S^-k, perhaps as a 
lookup table, algorithm, or combination of the two. However, continuous subsets are 
preferred. 

25 The above description is made more practical in light of the following discussion on the 
design of specific puncture sequence for use with a given mother code that allows for 
implementation of all possible effective coding rates. An initial assumption is that the 
needed Eb/N 0 to achieve a particular performance measure is relatively well behaved (i.e., 
non-random) from one puncture to the next. Using this assumption and a given LDPC 

30 mother code, the invention constructs element-by-element the puncture sequence by 
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determining the next variable degree 32 to puncture that requires the least amount of 
Eb/No for the code ensemble, defined by (/i(x), p(x), tt (Q) (x)) , to achieve a target bit error 

rate (BER) where x {0 \x) = tt^V" 1 . Thus, this invention is greedy in Eb/N 0 when 

determining the next variable degree 32 to puncture, and the punctured nodes 26 are 
5 restricted to conform to this degree sequence. 

The present invention may be employed for any discrete communication system 
employing multiple coding rates using LDPC codes for the error control system. The 
wide range of code rates allows for more flexibility in the communication system. Some 
1 0 applications that would use this flexibility are future adaptive coding techniques based on 
LDPC codes that attempt to adjust the code rate according to channel realizations or 
statistics. 

An alternate approach that is within the scope of this invention fixes the Eb/No to insure 
1 5 convergence (i.e. Et/No threshold has been met for the ensemble) for a wide range of code 
rates by determining the next puncture degree 32 using the smallest number of iterations 
to achieve the target BER. Unlike the first approach that was greedy in- Eb/No, this 
alternate approach is greedy with respect to complexity (i.e. number of decoder 
iterations). A second alternative embodiment is based on the asymptotic thresholds of the 
20 code ensemble, which is determined by the edge distributions A,(x) and p(x). 

A more detailed description of the "greedy in Eb/No" approach to designing puncture 
codes follows. It is based upon a Gaussian Approximation of a BER expression to search 
for the Et/No that meets the target BER using a finite number of decoding iterations given 
25 a punctured code ensemble, defined by the set (/l(x), p(x), 7U (0) (x)) . Those skilled in the 

art could readily extrapolate the algorithm to include the alternate approaches based on 
the asymptotic Eb/N 0 thresholds and the approaches greedy in decoding complexity that 
were suggested above. 

30 Considering again the general discrete communication system 36B of Figure 2B that uses 

r 
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LDPC coding for its error control, communicating K bits of information per codeword 
using different code rates by puncturing the code words encoded from a single LDPC 
mother code of rate K/N where N is the length of the code words. 
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The following algorithm determines a single variable degree 32 puncturing sequence for 
an LDPC code. This approach is different than the approaches using Linear 
Programming (LP) and differential evolution techniques of the prior art. Variable degree 
subsets from a single puncture sequence, where the subset of the next higher rate contains 
the subset of the previous lower rate and so forth as described above, are used. For the 
highest supported code rate Rmax^RN k, the entire puncture sequence S N -k is then used. 
This is fundamentally different approach from the prior art and results in a significant 
reduction of required implementation memory for a large set of code rates derived from a 
single mother code. 



15 For the AWGN channel, the Gaussian Approximation (GA) technique models the 
messages sent to the check nodes 28 from the variable nodes 26 as a linear combination 
of Gaussian random variables. Through empirical study, it has been found that this 
approximation is fairly accurate for the variable messages sent to the check nodes 28 
using an iterative sum-product decoding algorithm, also known as belief propagation. By 

20 only tracking the message means, this approximation simplifies the performance analysis 
over the prior art Density Evolution (DE) previously used to design LDPC code 
ensembles. 



GA BER Expression Based on Message Mean Evolution : The mean value update 
25 equation for the k th iteration of a punctured LDPC code ensemble is 



s=2 



1- 
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where </>(x) and its inverse </> (y) is defined by Sae- Young Chun, "On the Construction 
of Some Capacity- Approaching Coding Schemes", PhD dissertation, MIT, 2000, herein 
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incorporated by reference. Further parameter descriptions are as described by Jeongseok 
Ha and Steven W. McLaughlin, "Optimal Puncturing of Irregular Low-Density parity- 
Check Codes" and "Optimal Puncturing Distributions for Rate-Compatible Low-Density 
Parity-Check Codes", preprints submitted to IEEE ICC 2003, March 2003; and to IEEE 
Transactions of Information Theory, 2003, respectively, and each incorporated by 
reference herein. Using the above GA mean update equation, the BER expression after 
the k ,h decoding iteration is: 



n = 



v E Z— ^ j 2 1=1 

unrecovered punctured symbols ^— — . - .... - ■■ v- 



imy+m Uo 



y-2 i=o 



recovered punctured symbols unpunctured symbols 



10 The "greedy Eb/No" approach for determining the puncture degree sequence may be 
summarized as follows. For each available variable degree puncture, calculate the 
required mean input LLR values, m t ^ , that achieve the design criteria on the ensemble of 

codes. Design criteria may include but are not limited to: a target BER within a finite 
number of iterations using the GA BER expression (greedy in SNR); the asymptotic SNR 
1 5 threshold using DE or GA (greedy in SNR); and the number of decoding iterations for a 
target BER (greedy in complexity). 



Next, select the variable degree, j , within the design criteria for puncturing that required 

the smallest mean input LLR value (or smallest in decoding complexity) and append the 
20 degree to the puncturing sequence. Taking into account a specific code length and the 
finite number of variable nodes of each degree, adjust the puncturing probability for the 

punctured variable degree, /r^ 0) . Finally, return to the first iterative step (calculate the 

required mean input LLR values) and repeat until the puncturing sequence length 
corresponds to the Binary Erasure Channel (BEC) threshold for random errors (or 
25 alternatively until the code rate equals 1 .0). Stop the iteration if the fraction of punctured 
variable nodes 26 reaches or is beyond the BEC threshold. Note that the above algorithm 
could use a different stopping criterion other than the BEC threshold. Stopping at the 
BEC threshold corresponds to a transmitted punctured code through a noiseless channel 
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(i.e. very large F4/N0). 

, * « 

Examples : Following are examples of various puncturing probabilities for various length 
LDPC codes realized randomly from the following code ensemble described by the 
5 distributions of the variable edges 30 and the check edges 31: 

At =0.25105 p n =0.63676 
^=0.30938 pz = 0.36324 
A 4 =0.00104 
4 0 =0.43853 

These edge distributions 30, 31 correspond to a 0.5 code rate where {^,^,^4,^0} 
correspond to the fraction of total variable edges 30 connected to variable nodes 26 of 
degrees {2,3,4,10} respectively and {/> 7 ,/? 8 } correspond to the fraction of total check 

10 edges 3 1 connected to check nodes 28 of degrees {7,8} respectively. 

Figure 7 is a graph illustrating the puncturing probabilities {^ 0) ,^" 3 (0) ,^ 0) ,^ 1 ( o ) } 

(corresponding to the variable degrees of {2,3,4,10} respectively) versus the effective 
code rate for the puncturing sequence derived from the greedy algorithm based on a target 
1 5 BER within a finite number of iterations using the GA BER expression (presented above) 
of a length N = 1082 LDPC code. Similarly, Figure 8 is a graph illustrating the 
puncturing probabilities for the puncturing degree sequence of a length N = 3255 LDPC 
code. For both puncturing degree sequences, the asymptotic E b /N (; threshold in dB is 

plotted versus the effective code rate in Figures 12 and 16 respectively. 

20 

Because for each code realization, the beginning subset of a single puncturing degree 
sequence is used (thus encapsulating the previous subsets of the lower rate codes), the 
puncturing probabilities are monotonically increasing. Note that the degree sequence is 
specified by these graphs and not the actual node sequence. The actual variable node 26 
25 puncture sequence has many permutations within a specified degree 32 sequence, so it 
still maybe possible to optimize (for some desired design criterion) the node 26 sequence 
further within the degree 32 sequence. For the work herein described, the node 26 
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sequence was chosen as the first available in the subset of nodes 26 corresponding to the 
punctured degree 32. v 

Present in both N = 1082 and N == 3255 examples are large jumps in discontinuities for 
5 the puncturing probability of variable nodes 26 of degree 4* Such discontinuities are 
similar to those present in the prior art. They exist because X 4 is relatively small with 

respect to {^Aj^ol* resulting in very few variable nodes 26 of degree 4. For 

codeword length N = 1082, there is only one variable node 26 of degree 4, and for 
N = 3255 , there are only three variable nodes 26 of degree 4. Furthermore, these large 
10 steps in the puncture probability highlight the discrete nature of the problem for LDPC 
code realizations of practical codeword lengths not addressed by prior art approaches. 

r 

Results : Figures 9-16 are graphs illustrating results for BPSK/AWGN Monte-Carlo 
simulations of the puncturing degree sequences illustrated in Figures 7 and 8, and 
1 5 constructed in the greedy approach described above. In constructing the two puncturing 
sequences for each mother code respectively (degree sequences in Figures 7 and 8), the 
target BER of lxlO" 6 for fifty iterations of the code ensemble was used as the design 

i 

criterion in the greedy algorithm outlined above. 

20 Figures 9 and 13 are Bit-Error-Rate (BER) versus E b /N 0 6R simulation results for 

punctured LDPC mother codes of lengths 1 082 and 3255 respectively using 1 00 decoder 
iterations. The simulations ran until the earlier of 300 codeword errors or until 50,000 
code words. Figures 10 and 14 are Codeword-Error-Rate (CER) versus E b jN 0 dB 

simulation results for punctured LDPC mother codes of lengths 1082 and 3255, 
25 respectively, using 1 00 decoder iterations. 

Figures 1 1 and 1 5 plot the SNR gap with respect to the binary signaling Shannon capacity 
limit at BER=lxl0~ of the punctured LDPC code performance using 100 iterations and 
mother code lengths of 1082 and 3255 respectively. It can be seen that for a wide range 
30 of code rates the punctured code's performance measured by the SNR gap remains fairly 
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constant, within 0.5dB for code rates up to around 0.7 for codeword length 1 082 and up 
to code rates up to 0.75 for codeword lengths 3255. Thus for longer codeword lengths, 
the punctured code performs better. Such is normally true for LDPC codes employing 
belief propagation decoding, because of the independence assumption concerning the 
5 passed messages. For shorter length codes, messages become correlated relatively faster 
than messages of longer length codes (assuming for both that the parity check matrix is 
properly designed to eliminate short cycles). Figures 12 and 16 plot the SNR 
corresponding to BER= 1 x 1 0 r of the punctures LDPC mother codes of lengths 1 082 and 
3255 respectively along with the binary Shannon capacity limit also at BER=lxlO" 3 . 

10 

While there has been illustrated and described what is at present considered to be a 
preferred embodiment of the claimed invention, it will be appreciated that numerous 
changes and modifications are likely to occur to those skilled in the art. It is intended in 
the appended claims to cover all those changes and modifications that fall within the 
15 spirit and scope of the claimed invention. 
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